Skip to content

Serialize purgeRequested as a lowercase boolean in REST drop_table - #4341

Merged
kevinjqliu merged 2 commits into
apache:mainfrom
Anurag-S1ngh:fix/3836-rest-drop-table-purge-requested
Nov 11, 2026
Merged

kevinjqliu merged 2 commits into
apache:mainfrom
Anurag-S1ngh:fix/3836-rest-drop-table-purge-requested

Conversation

@Anurag-S1ngh

Copy link
Copy Markdown
Contributor

Closes #3836

Rationale for this change

RestCatalog.drop_table passed the purge_requested boolean directly into the requests query params, and requests serializes True as "True". The REST catalog spec defines purgeRequested as a boolean query parameter, so spec-compliant servers reject the capitalized form with 400 Bad Request (for example OSS Tables, which only supports dropping tables with purge enabled).

This sends the spec-compliant lowercase "true" / "false" explicitly, matching how the other query parameters in the REST client are serialized. purge_table goes through the same code path.

Are these changes tested?

Two regression tests in tests/catalog/test_rest.py assert the exact query string on the wire for purge_requested=True and for the default False. The assertion is on the raw request URL rather than request.qs because requests_mock lowercases parsed query values, which would hide the bug.

tests/catalog/test_rest.py passes (192 tests) and prek run is clean on the changed files (ruff, ruff-format, mypy, codespell).

Are there any user-facing changes?

RestCatalog.drop_table and purge_table now serialize purgeRequested as a lowercase boolean, fixing 400 responses from servers that validate the parameter strictly.

@kevinjqliu kevinjqliu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

…rge_table

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@kevinjqliu

Copy link
Copy Markdown
Contributor

i pushed a change to consolidate the tests based on my agent's suggestion 😄

01002b4

@kevinjqliu
kevinjqliu enabled auto-merge November 11, 2026 17:53

@rambleraptor rambleraptor left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had approved #3837 which it looks like was closed by the stale bot. This looks like the equivalent. Thanks for doing this!

@kevinjqliu
kevinjqliu added this pull request to the merge queue Nov 11, 2026
Merged via the queue into apache:main with commit ab67e68 Nov 11, 2026
20 checks passed
krishan711 added a commit to krishan711/iceberg-python that referenced this pull request Nov 12, 2026
…of-structs

* upstream/main: (78 commits)
  fix(io): keep null lists of structs when projecting Arrow data (apache#4065)
  Skip unknown nested fields when resolving Avro read schemas (apache#4289)
  fix(expressions): reject non-finite floats on conversion to Decimal (apache#4287)
  fix: handle negative-scale Decimals in increment, decrement and truncate_decimal (apache#4285)
  Match NaN partition values with `IsNaN` in partition predicates (apache#4281)
  Fix append when a data column is named like a partition helper column (apache#4344)
  Widen decimal literal precision in scan filters (apache#4348)
  Add row-lineage support with Spark tests (apache#3972)
  Serialize purgeRequested as a lowercase boolean in REST drop_table (apache#4341)
  Validate each branch against its own commits on retry (apache#4317)
  Core: Compare upsert rows column by column instead of cell by cell (apache#4334)
  Core: Write added files under the partition spec they were planned with (apache#4338)
  Core: Check whether a failed last commit attempt landed before cleanup (apache#4339)
  REST: Use the standard User-Agent format (apache#4330)
  SQL: Accept an existing SQLAlchemy engine in SqlCatalog (apache#4336)
  Expose catalog labels on Table (apache#4321)
  Respect REST endpoint capabilities when checking view existence (apache#4337)
  Reject existing ref names in create_branch and create_tag (apache#4319)
  Assert every ref a transaction writes, not just the first (apache#4315)
  feat: send Idempotency-Key on REST mutations when the server advertises it (apache#4310)
  ...

# Conflicts:
#	pyiceberg/io/pyarrow.py
#	tests/io/test_pyarrow.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] REST catalog drop_table serializes purgeRequested as "True" instead of "true"

3 participants